Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 94.58 | 82.09 | 88.53 | 84.00 | 84.16 | 81.97 | 88.46 | 79.05 | 74.75 | 71.76 | 59.31 | 66.30 | 69.46 | 67.26 |
Bulgarian | 99.91 | 99.91 | 94.17 | 97.62 | 94.34 | 95.39 | 93.78 | 94.60 | 94.37 | 91.77 | 89.19 | 82.04 | 81.60 | 88.84 | 88.19 |
Czech | 99.88 | 99.88 | 93.18 | 97.83 | 90.88 | 90.77 | 89.71 | 97.42 | 93.72 | 91.91 | 90.74 | 78.14 | 87.85 | 86.63 | 85.51 |
Dutch | 99.74 | 99.74 | 69.26 | 92.60 | 89.88 | 92.01 | 89.00 | 94.41 | 88.75 | 86.29 | 81.18 | 69.95 | 74.83 | 81.21 | 80.72 |
English | 99.22 | 99.22 | 83.82 | 93.63 | 92.77 | 94.09 | 90.70 | 95.41 | 90.94 | 88.70 | 87.01 | 76.62 | 82.13 | 85.76 | 85.30 |
Estonian | 99.70 | 99.70 | 89.98 | 94.99 | 96.23 | 92.80 | 90.97 | 90.37 | 87.35 | 84.25 | 82.58 | 73.41 | 72.13 | 81.98 | 81.36 |
Finnish | 99.70 | 99.68 | 88.65 | 94.83 | 54.52 | 93.02 | 51.82 | 87.09 | 93.32 | 91.84 | 90.90 | 81.06 | 75.08 | 83.70 | 82.96 |
French | 99.78 | 99.36 | 95.46 | 93.94 | 99.36 | 76.02 | 73.29 | 96.07 | 92.52 | 89.33 | 85.53 | 45.77 | 80.63 | 88.28 | 86.23 |
Italian | 99.93 | 99.84 | 98.76 | 97.18 | 97.04 | 97.10 | 96.17 | 97.37 | 95.03 | 93.66 | 90.67 | 85.17 | 86.54 | 89.04 | 88.52 |
Latvian | 99.33 | 99.33 | 98.74 | 93.48 | 84.29 | 89.55 | 83.93 | 92.73 | 89.07 | 85.98 | 83.79 | 69.77 | 76.67 | 79.66 | 79.19 |
Lithuanian | 99.91 | 99.91 | 87.87 | 90.33 | 80.69 | 81.20 | 79.33 | 88.75 | 81.97 | 77.63 | 75.27 | 54.78 | 64.19 | 68.24 | 66.12 |
Polish | 99.40 | 99.83 | 97.52 | 96.43 | 84.87 | 83.62 | 80.35 | 95.60 | 94.27 | 91.88 | 90.35 | 67.75 | 84.86 | 86.79 | 82.39 |
Russian | 99.60 | 99.60 | 98.80 | 97.78 | 99.60 | 85.34 | 84.97 | 96.55 | 94.20 | 92.87 | 91.71 | 71.57 | 87.70 | 88.93 | 88.60 |
Slovak | 100.00 | 100.00 | 85.28 | 92.93 | 77.06 | 80.34 | 76.71 | 86.56 | 92.64 | 90.61 | 89.29 | 63.85 | 73.13 | 84.73 | 82.72 |
Swedish | 99.18 | 99.18 | 93.54 | 93.35 | 90.96 | 84.87 | 83.15 | 89.98 | 88.29 | 85.23 | 83.63 | 64.01 | 73.19 | 79.11 | 78.19 |
Tamil | 99.16 | 94.51 | 97.52 | 81.31 | 76.35 | 80.45 | 75.59 | 84.14 | 65.57 | 58.69 | 54.73 | 44.18 | 48.22 | 58.66 | 54.26 |
Ukrainian | 99.85 | 99.81 | 96.61 | 94.91 | 84.03 | 84.28 | 83.32 | 93.56 | 91.01 | 88.91 | 86.45 | 65.84 | 78.78 | 80.34 | 79.69 |
Average | 99.66 | 99.06 | 91.25 | 93.63 | 86.87 | 87.35 | 82.63 | 92.30 | 88.95 | 86.14 | 83.81 | 67.84 | 76.11 | 81.26 | 79.84 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 94.58 | 82.09 | 88.53 | 84.00 | 84.16 | 81.97 | 88.46 | 79.05 | 74.75 | 71.76 | 59.31 | 66.30 | 69.47 | 67.26 | (no xsubj) | 67.26 | 67.26 |
Bulgarian-BTB | 99.91 | 99.91 | 94.17 | 97.62 | 94.34 | 95.39 | 93.78 | 94.60 | 94.37 | 91.77 | 89.19 | 82.04 | 81.60 | 88.84 | 88.19 | 88.19 | 88.19 | |
Czech-FicTree | 99.98 | 99.93 | 89.65 | 95.71 | 73.59 | 76.55 | 69.91 | 96.34 | 94.06 | 92.26 | 91.06 | 54.74 | 86.02 | 86.76 | 85.66 | 83.95 | 85.51 | |
Czech-CAC | 99.97 | 99.96 | 93.10 | 96.98 | 89.05 | 88.63 | 87.59 | 96.27 | 93.46 | 91.67 | 90.34 | 75.21 | 85.91 | 84.55 | 83.41 | 83.95 | 85.51 | |
Czech-PDT | 99.93 | 99.93 | 93.35 | 98.22 | 92.74 | 92.42 | 91.89 | 97.83 | 94.04 | 92.43 | 91.35 | 81.03 | 88.81 | 87.19 | 86.15 | 83.95 | 85.51 | |
Czech-PUD | 99.27 | 99.27 | 95.93 | 96.51 | 90.04 | 89.39 | 88.40 | 95.32 | 90.60 | 86.97 | 84.97 | 71.88 | 81.46 | 82.53 | 80.60 | (no codepend) | 83.95 | 85.51 |
Dutch-Alpino | 99.83 | 99.83 | 88.59 | 94.11 | 91.47 | 93.31 | 90.70 | 95.11 | 91.80 | 89.46 | 85.50 | 74.95 | 79.54 | 84.67 | 84.34 | 80.80 | 80.72 | |
Dutch-LassySmall | 99.65 | 99.65 | 53.62 | 91.16 | 88.37 | 90.77 | 87.37 | 93.74 | 85.83 | 83.27 | 77.18 | 65.32 | 70.46 | 77.91 | 77.26 | 80.80 | 80.72 | |
English-EWT | 98.90 | 98.90 | 77.40 | 93.26 | 92.75 | 94.23 | 91.30 | 95.45 | 89.81 | 87.61 | 85.54 | 76.57 | 81.28 | 84.65 | 84.28 | 85.40 | 85.30 | |
English-PUD | 99.59 | 99.59 | 96.00 | 94.06 | 92.80 | 93.92 | 89.98 | 95.37 | 92.27 | 90.00 | 88.86 | 76.67 | 83.20 | 87.07 | 86.51 | 85.40 | 85.30 | |
Estonian-EDT | 99.96 | 99.96 | 91.56 | 95.61 | 96.76 | 93.41 | 91.75 | 90.58 | 88.47 | 85.56 | 83.92 | 75.08 | 73.21 | 83.76 | 83.29 | (no xsubj) | 77.84 | 81.36 |
Estonian-EWT | 98.48 | 98.48 | 80.46 | 92.03 | 93.72 | 89.88 | 87.21 | 89.34 | 82.03 | 77.99 | 76.09 | 65.27 | 66.93 | 73.76 | 72.39 | (no codepend, no xsubj) | 77.84 | 81.36 |
Finnish-TDT | 99.71 | 99.70 | 88.64 | 94.27 | 95.41 | 91.93 | 90.69 | 86.88 | 93.08 | 91.67 | 90.79 | 79.62 | 74.75 | 84.02 | 83.40 | 82.97 | 82.96 | |
Finnish-PUD | 99.67 | 99.66 | 88.66 | 95.57 | 0.00 | 94.47 | 0.00 | 87.36 | 93.64 | 92.06 | 91.05 | 82.94 | 75.51 | 83.48 | 82.55 | (no codepend, no xsubj) | 82.97 | 82.96 |
French-Sequoia | 99.58 | 98.88 | 75.77 | 94.54 | 98.88 | 77.13 | 75.53 | 96.01 | 91.94 | 90.61 | 88.25 | 50.25 | 84.27 | 88.57 | 87.67 | (no gapping, relcl, case) | 87.08 | 86.23 |
French-FQB | 99.87 | 99.57 | 99.08 | 93.69 | 99.56 | 75.56 | 72.35 | 96.10 | 92.76 | 88.80 | 84.41 | 43.93 | 79.13 | 88.04 | 86.48 | (no gapping, relcl, case) | 87.08 | 86.23 |
Italian-ISDT | 99.93 | 99.84 | 98.76 | 97.18 | 97.04 | 97.10 | 96.17 | 97.37 | 95.03 | 93.66 | 90.67 | 85.17 | 86.54 | 89.04 | 88.52 | 88.52 | 88.52 | |
Latvian-LVTB | 99.33 | 99.33 | 98.74 | 93.48 | 84.29 | 89.55 | 83.93 | 92.73 | 89.07 | 85.98 | 83.79 | 69.77 | 76.67 | 79.66 | 79.19 | 79.19 | 79.19 | |
Lithuanian-ALKSNIS | 99.91 | 99.91 | 87.87 | 90.33 | 80.69 | 81.20 | 79.33 | 88.75 | 81.97 | 77.63 | 75.27 | 54.78 | 64.19 | 68.24 | 66.12 | 66.12 | 66.12 | |
Polish-LFG | 97.66 | 99.87 | 98.25 | 96.35 | 77.84 | 70.08 | 58.92 | 95.77 | 95.27 | 92.91 | 91.66 | 50.00 | 86.10 | 91.33 | 86.69 | (no gapping) | 83.22 | 82.39 |
Polish-PDB | 99.86 | 99.84 | 97.51 | 97.07 | 88.11 | 88.37 | 87.30 | 95.94 | 93.95 | 91.69 | 90.21 | 74.04 | 85.08 | 85.59 | 80.98 | 83.22 | 82.39 | |
Polish-PUD | 99.79 | 99.77 | 96.28 | 95.31 | 83.95 | 84.58 | 82.95 | 94.87 | 94.13 | 91.50 | 89.71 | 68.72 | 83.63 | 85.85 | 81.99 | 83.22 | 82.39 | |
Russian-SynTagRus | 99.60 | 99.60 | 98.80 | 97.78 | 99.60 | 85.34 | 84.97 | 96.55 | 94.20 | 92.87 | 91.71 | 71.57 | 87.70 | 88.93 | 88.60 | 88.60 | 88.60 | |
Slovak-SNK | 100.00 | 100.00 | 85.28 | 92.93 | 77.06 | 80.34 | 76.71 | 86.56 | 92.64 | 90.61 | 89.29 | 63.85 | 73.13 | 84.73 | 82.72 | 82.72 | 82.72 | |
Swedish-Talbanken | 99.89 | 99.89 | 96.13 | 95.59 | 93.90 | 94.46 | 92.87 | 95.38 | 91.51 | 88.91 | 86.82 | 78.12 | 81.02 | 82.55 | 81.76 | 78.05 | 78.19 | |
Swedish-PUD | 98.41 | 98.41 | 90.47 | 90.94 | 87.80 | 74.58 | 72.73 | 84.19 | 84.83 | 81.27 | 80.21 | 48.88 | 64.79 | 75.39 | 74.33 | 78.05 | 78.19 | |
Tamil-TTB | 99.16 | 94.51 | 97.52 | 81.31 | 76.35 | 80.45 | 75.59 | 84.14 | 65.57 | 58.69 | 54.73 | 44.18 | 48.22 | 58.65 | 54.24 | (no gapping, xsubj, relcl) | 54.24 | 54.26 |
Ukrainian-IU | 99.85 | 99.81 | 96.61 | 94.91 | 84.03 | 84.28 | 83.32 | 93.56 | 91.01 | 88.91 | 86.45 | 65.84 | 78.78 | 80.34 | 79.69 | 79.69 | 79.69 | |
Average | 99.56 | 99.23 | 90.37 | 94.11 | 85.86 | 86.84 | 80.90 | 92.88 | 89.87 | 87.20 | 85.03 | 67.49 | 77.65 | 82.34 | 80.87 | 79.64 |